Papers with information rate
Construction Repetition Reduces Information Rate in Dialogue (2022.aacl-main)
Copied to clipboard
| Challenge: | We observe that construction usage lowers the information content of utterances. |
| Approach: | They propose to use construction repetition to mitigate information rate in English open-domain spoken dialogues. |
| Outcome: | The proposed method lowers the information content of utterances, while increasing the frequency and density of repetition. |
Revisiting the Optimality of Word Lengths (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing theories of communication cost are based on the length of an utterance, but they are not based upon the frequency of the utterant. |
| Approach: | They propose a method to minimize CCH's cost by comparing language lengths to surprisal's expectation and variance-to-mean ratios. |
| Outcome: | The proposed method does not minimize CCH’s cost, but rather a lower bound, which we term CCH-lower. |
Efficiency and Effectiveness in Task-Oriented Dialogue: On Construction Repetition, Information Rate, and Task Success (2024.lrec-main)
Copied to clipboard
| Challenge: | Repetition of constructions in task-oriented dialogue can have negative and positive effects on information rate and delivery, but is also predictive of task success. |
| Approach: | They investigate the role that efficiency and effectiveness play in speakers’ repetition of shared word sequences, or constructions, in task-oriented dialogue. |
| Outcome: | The results show that repeating constructions has negative and positive effects on information rate and delivery and that information rate managing strategies are predictive of task success. |
Surprise! Uniform Information Density Isn’t the Whole Story: Predicting Surprisal Contours in Long-form Discourse (2024.emnlp-main)
Copied to clipboard
| Challenge: | Uniform Information Density (UID) hypothesis posits that speakers tend to distribute information evenly across linguistic units to achieve efficient communication. |
| Approach: | They propose a functional pressure that speakers modulate information rate based on location within a hierarchically-structured model of discourse. |
| Outcome: | The proposed hypothesis posits that speakers tend to distribute information evenly across linguistic units to achieve efficient communication. |
The Harmonic Structure of Information Contours (2025.acl-long)
Copied to clipboard
Eleftheria Tsipidi, Samuel Kiegeland, Franz Nowak, Tianyang Xu, Ethan Wilcox, Alex Warstadt, Ryan Cotterell, Mario Giulianelli
| Challenge: | Language typically does not maintain a uniform information rate, but it fluctuates around a global average . a new study suggests periodicity may be a factor in information rate oscillations . |
| Approach: | They propose a hypothesis that language does not maintain a uniform information rate . they apply harmonic regression and introduce a new extension to detect periodicity . |
| Outcome: | The proposed method reveals that language oscillates at periodic intervals across frequencies . it also offers a framework for uncovering structural pressures at various levels of linguistic granularity. |